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The distribution of reading~research eitabicns was 


inventigaied in three populations of journals. The rule of 
_Pareto-like distribution was confirmed as appropriate for determining 
the number cf journals that would contribute half the citations in 
populations of 26 to 112 journals. In populations of 42 to 112 
journals,” 24% to 29% of the high-ranking journals were necessary to 
account for 80% of the citations. In two furthet saaples, chosen on 
different criteria, more than 35% of the journals were necessary to 
account for 80% of the citations. Implications for both researchers 


and librarians are discussed. 
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Distributions of scenes Citations in Small Collections : 


of Reading Research — 


rt -~ ae 4 
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AN ABSTRACT 


Growth rules were applied to citation distribution AV 


‘in thige small journal populations derived from collections Rs 


vm as appropriate, for determining the small . 
number of jéurhals that would conteibbge halt the ‘cita- ° 


journal populations of from 42 toNLl2 journals, which 


represented entire collections or entire random samples, " 


from 24% to 2%. of the high ranking journals were 
¢ : 
necassary, to account for an. 80% core. of citations. In mt 


the unique portions of two, random sanples, more than 
35% of the journals were  neceauary. to account for an 


ws L 


80% core of citations. 
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_ Distributions of Journal Citations in Small Collection® . = 


_ of Reading - Research 7. a ee! | Z 


Bea Mayes ahs. 4 ) 


; 7 . . ‘ * : v . 
..In any area of inquiry rules of growth and distribution , ' 


of population are useful to forecasters and practitioners. 
Price (1963) ‘was interested in the growth of science. He 
applied rules of growth to scjentific contribution. , The rg 
" growth of citiés and income istribution had been shown to 
‘follow Pareto-like distribution, Price demonstrated that ey aed 
scientific productivity and journal usage also followed a ; =< = 
Pareto-like distributivn. As a population ows -in Pareto- J / 
like distribution, the large producers becon®| larger, while | 
the smaller producers merely increase in numbers. As the . ro 4 
population of all cities grows, the ieceee cities become © »/ 
' still larger, while the ranks of the small cities are. Me 
added to by the development of stitl nore small cities, 
Sgmilarly, the high producing scientists produce a large 
share of all scientific papers, while the ranks of low re 
producers are swelled by scientists who may publish only 
| one paper. In a bibliography, a small ‘number of journals 
‘will answer one half the user demand, while all the other 


- 


journals togettier will satisfy the remainder of the re- 


quests.. The dividing line between the high producers in” . ~ Ht . 
any of these populations ‘and the low eeeducwea ee the oF ay . f™ 
number equal to the square root of the total population, oe 

according to the rule of Pareto-like ddatetbution. This 

‘rule defines the small number of large producers and . 

separates them from the. many emall producers: within the 

population. 3. : | ; | ry 
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Price confirmed . Pareto-like dlecribution using ‘data 


‘ doblecres by prquhart (1958) at the. 'getence Library ‘in 


London. . In this. large scientific collection he also found 


~ that: ‘less than 10% of the journals were sufficient to - 


+N 
account for ‘an 80% core of user demand. ‘ 
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The notion of rules of distribution ‘of citations or 


demand in a bibliographic collectionvis of particular . 


,interest to librarians and scholars. The researcher reason- 


ed that the task of making ae ‘information useful 


was two-fold. First, these rules must be shown re be 


generally applicable. Second ,* known collections’) f research 
must be analyzed to discover the sources most pert? ent to. 
given topics. Once the major: journal contributors a topic 
have been identified, both Libs rians and students wikl find 


their jobs simplified. The librarian organizing a collection 


can depend on distribution analyses in known collections to 


determine the most cited journals on a given topic. Students 


‘looking for a good central core of information on a topic . 


‘need only consult the relatively small number of journals 


found to be large contributors on that topic. The application 


of general rules concerning use and citation distribution 


- in collections will ablon librarians and students in a field 


_ to identify those journal sources which will be eas fruitful 


in study ing research on a given topic. 
The Study 
This study developed from Price's notion of growth rules. 


It applied his numerical results to bibliographic citations 
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bs e , 8 as 36: 
in sample populations from gwo bibliographies of ‘reading . 
research in order to. test the wider application. “OF the 
growth cules. ia Wicacnisatce contended that in small 
journal populations, Price's finding that 10% of the 
journals in a bibliography, could supply an 80% core of 
the products MAS SagrePareh te with the rule 9f Paretar 
like distribution. If Price's numerical pineinns were 
true growth measures they. could be applied ‘© other popu- 
iabtone. The nari’ relationships. would apply equally 
i to gieabtans or demand. _Tis study tested-thege rules by 
applying them to eitation distribution in emall journal « 


populations. ~ 
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Two bibliographies on closely related bkee were 
_ used, the Literature Search in Reading bibliography compiled — 
by Kling and his associates (Davis, 1971) and the ERIC/CRIER 
bibliography Recént Research in Reading (CCM Information 
Corporation, 1970); both collections“of reading research.\ 
Journal populations derived from these two biblicgraphios | 
were used to test the rule of Pareto-like distribution and 
Price's findings concerning an 80% core of a bibliography. 
Journal citations accounted for a major portion of the 
source citations in the sample populations studied,. i 
a a | sg 

Backsround of the Study Se A v 

Price found Pareto-like diatributions in scientists" 
productivity and in’ the requests for journals in a large 
scientific bibliography. In addition, his reanalysis of 
Urquhart 's data iron the Science bibcady in London showed 
5 j 
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‘From an arithmetical | point of view, Price! 8s two measures 


.the square root rule of Pareto-like ‘distribution. However , 
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that in this Large scientific ‘collection. 10% of the top vetiee 


4, 
ed journals wire sufficient to meet 80% of the user PAGGSSE RS 


were incompatible in small bibliographies. For ‘example, if 
a collection contained’ 109 journals, the tén top-ranked i 


journals would account for 50%. of the products, if one used 


ito Price's results. from the Science EAPEery these 
nals should siae account for a core of 80% \ 
cts. Furthermore, in a population of 49 journ 1s, 


8 would: account for 50% of the products accofd- 


ing to the r le of Pareto: like distribution, while only 5 


_ joarnals would contribute a core of 80% of | the peadeeen if 


one applied Price’ 8 results. In a population of nine jour- 

nals, three journals would supply. 50% of the products accord 

ing to Parerovlike dieeribution, while only one journal . - 
would contrib re an 80% core of the products. accord ing to 

Price’ 8 findings. These, are incompatible conclusions. As 

the ates of a pa ichins decreases numerically. below 100 the 

top 10% of the journals which is said to produce 80% of the. 

products becomes numerically smaller than the square root. of: | ‘ \ 
the total which should account for 50% of the products. This 


+ 
results in increasing incompatability. 
me ; ne ‘ 


It. seemed apparent that either the rule of Pareto-like ° 


distribution or Price's measure for determining an 80% core 


in a bibliography was inappropriate in small journal popu- - 


lations. The rule of Pareto-like distribution is appro- 
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priate to other populations (Price, 1963). For: this 
reason it seemed likely that tile rile would be confirmed - 7 
in the journal populations tested. Price's rule for Saget 
‘termining an 80% core was determined from the products of % 
a very ‘large bibliography. Et seemed probable that this 2 
rule would not be confirted ds the small journal popule- 
| tions used in this study. The researcher undertook to 


_ determine which, if either, of these rules appli di to 


i 
citation distribution in three journal po ions derived ' 


from collections of reading research. 


The hypothesis of this study were; 


1) analysis of citation frequenc i en 


equal to the‘ square root of ithe a 
_ 1 


-population would supply 50%. 

, uf 
citations. aM 

2) analysis of pitation frequenc {a 


¢ {RH 


af di 
journal populations would | ne 


spas 


_ Summers (1968) presented a detailed analysis of the 
journal contributors to the William S. Gray Collection of 
reading research. Summers found that from 24+29 per cent. 


of his high ranking journals made up an 80 per cent core 


of citations. The contents of ERIC/CRIER Recent: Research 


in Reading is summarized by Laffey (1970). Mayes (1973) 


y puma Tee the GOmpLIaeLon of the Literature Search in Read- 


ine bibliography. The efficacy of titles in describing 
contents was studied by Bernard (1963) and Sedano (1964). 


-Hammond (1965) discussed WH io cceratintiies of indexing 


by different. agents. * 
Price (1963) emphasized the exponential growth of 
ac pence tn general, illustrating this trend with figures. 
on srowth of journals, productivity of scientists, and 
utilization of scientific bibliography. A Pareto-like 


distribution is characteristic of growth in these areas 


o- 


" and reflects erystallization in the growth process, with 


the largest contributors growing at an ever increasing 


. rate. Price demonstrated Pareto-like distribution in 


scientific journal utilization. He concluded that a 
scientific bibliography followed a Pareto-like distribu- 
tion in its growth. Based on Urquhart (1958), -he also 

noted that less than 10 per cent of the available science 
serials were sufficient to meet 80% of the demand by users, 
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In order to provide éoapatabie data, the study used 
similar indexes for the Literature Search in Reading ; 
bibliography and the ERIC/CRIER bibliography Recent Re- 
Search in Reading. A‘KWOG (Key-Word-Out-Of-Context) index 
Wa prepared from the ERIC/CRIER materials to match the 
already existant KWOC index for Literature Search in Read- 
ing xy complets source listing was not available for 
cicece cue Search in Reading at the time.) The initial 
sampling cu from comparable kWOC* (Key-Word-OutOf-Context ) 
indexes for the two bibliographies. The. procedure was 


- experimental. It contrasted unique word universes obtained 


‘ from random samples taken from-the KWOC index. for Litera- 
ture Search in Reading and a similar KWOC index compiled 
for FRIC/CRIER Recent Ressarcl in Resting (Mayes, 1973). © 
The Key-Word-Qut-Of-Context | (KWOC) index is a  parmotation: j 
inde based on titles. Each ‘entry consists of a code, an 
index .word, ana the entire title, The computer collects 
all titles in which a specific word appears and arranges 
them in the index vader that key title word, For example, 
“all titles in which the word “attention” appears are listed 

under the key word “attention” in the index. The number of 


g yo Jig 
citations in the unique universe of a sample consisted of 


_ all the unique key words in the sample and each of: the 


titles “Listed under then. The unique universe of KWOC title 
words from each index. <n the journal aleces represented 
formed the main body of data of Mayes’ study. A secondary 


analysis identified all sources represented in the random 


sample of title words from Recent Research in Reading, as 
ae , 9 ' : re 


sb: 
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The journal popufations in the study were identified 
by tracing the titles identified in the samples tothe 
source materials they represented. Three journal popula- 
tions were analyzed: The journals represented in the unique 


portion of the random sample from the KWOC index of 


Literature Search in Reading, the journals represented in 
the unique portion of the random sample from the KWOC in- | 
dex of Recent. Research in Reading, and the journals . 
represented in the entire random sample from the KWOC 
index of Recent Research in Reading. ‘ 


Results 
Application of Rule of Pareto-like Distribution 


The square root: rile of Parétio~like distribution 
was applied to the contributions of journals traced from 
three sample popylations from the KWOC indexes. In the \ 
unique portion of the Literature Search sample, 11 of the 
112 journals contributed 48% of the 332 jootnal avvinies® c 
identified. In the unique portion of the ERIC/CRIER — 7 
sample, 5 of the 26 journals contributed 55% of the 104 
, journal articles identified. In the entire ERIC/CRIER ' 
sample 7 of the 51 journals contributed 65% of the 432 
journal articles identified.: The specific journals 
identified “si application of the rule of Pareto-like “ 
distribution appear in Table l.. The journals hrentities 
contribute approximately 0% of all ‘the journals identi- 
“thea in each of the three ‘éanple populations. That is 


to say, the Journal of Experimental Havcholoss, Jourrial : 
nena En a 


‘of Educational Psychology, the Journal of Verbal Learning 


' Psychology ties in contribution with the Journal of the 


ahd Verbal Behavior, Perception and Psychophysics, Science, 
Reading Teacher, Child Development,, Journal of Educational . > 
Research, American Journal ‘of Psychology, Perceptual and 
Motor Skille, and British Journal of Educational Psychology 
contribute approximately 50% of the journal citations in 
the unique portion of the Literature Search in Reading 

‘ 


sample. 


‘Perceptual and Motor Skills, Journal of Psychology, 
Psychological Reports, Journal of Reading, and Journal of 
Applied Psychology contribute approximately 50% of the 
journal citations in the unique portion of. the Recent 


Research in Reading sample. (The Journal of Applied 


Reading Spécialist. Either may be identified in fifth tank.) 


Paychological Reports, Perceptual and Motor Skills, ‘| 
Journal of Psychology, Elementary English, Reading Teacher, 
Journal of Reading and Journal of General Psycholozy contri- 
bute 65% of the journal citations in the entire at ae 


ERIC/CRIER Recent Research in Reading. 
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| . TABLE 1 . oo 
APPLICATION OF PARETO-LIKE DISTRIBUTION TO JOURNAL 
| CITATIONS DERIVED FROM THREE SAMPLE POPULATIONS | 
; oo ; 5 . : . 
nS 
; Se 
Literature Search in Reading: Journal citations from unique portion 


of random sample from KWOC index. These aeons supply 48% of. 
“the journal articles identified. 


| os e No. of 
Rank * Journal : . zt , 
1.0 Souenal of Experimental Psychology ' 38 
2,0 : fares of Educational. Psycholosy 20 
3,0 Journal of ‘Verbal Learning & Verbal Behavior Le 
4.5 Perception and Psychophysics i 13 
4.5 Science PF 13 
6.0 Reading Teacher | of ae © 
Tas Child Development . it, “ ll 
Te> Journal of ‘Edgeational pentane? allie » 2 ll 
9.5 hee icus Journal of Psychology — . “8 
9.5 Perceptual and Motor Skills | 9 


11.0 British Journal of Educational Psychology 7 


ERIC/CRIER Recent Research Reading:. Journal eitetione from unique 
portion of rdéndom sample from KWOC index. These journals supply 
55% of the journal articles identified. ' f 


‘ ; No. of . &. 
1.0 Perceptual and Motdt Skills + 20 é' 
2.0 Journal of Psychology | fe 16 
/3.0 Psychological Reports an 2 " 12 
4.0 " Journal of Reading _ 7 
5.5 ° Journal of Applied Paychology eo 5 6 
5.5 Journal of a Reading: Specialist * oF 
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_ ERLC/CRIER :: Journal citations from entire". 
random sample from KWOC e These journals supply 65% of: the . ‘i ere” 


journal articles identified. 


Age 
% Ns 


ee ; ; yo ‘No. of 
1,0 ‘ Psychological Reports 7 . _ 73 
2.0 ., Peréeptual and Motor Skills | gs 61 


3.0 Journal of Psychology ee | 
4.5. Elementary English - . " ? . 32° 
4.5 Reading Teacher - | i . ¥20 


6.0 ‘Journal of. Reading “ 23 
; Journal of General Psychology thee ; oe 20 . 
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Gutucetaatiea of an 80% core ~ ; | -€ 
Price conclyded that in a: large bibliography less than 
. 3 10 per cent of the high ranking” journals were eafficient to. 
ae 80 per cent of the demand. The conteibotions of 10 per 
cent of the high ranking journals were identified in the, 


three sample populations: In the unique portion of the: 


q 


“KRWOC sample from Literature Saicek in Reading, 11 journals 
oi (10%) supplied 48% of the citations. In the unique portion 
_of the KWOC sample from the ERIC/CRIER bibliography, 3 
jouenals (10%) supplied 46% of the citations. In the ERIC/ 
P CRIER total sample, 5 journals (10%) supplied 55% of ‘the 


KWOC citations. | ~ | 


A 
The high ranking journals contributing 80% of the . oe | 
_eitations in the three journal populations were identified: 
In thq unique portion of ie KWOC sample from Literature 
‘Search in Reading, 44% of ‘cis journals supplied 81.3% of 
the citations. . In the unique portion of the KyOC sample 
from the ERIC/CRIER bibliography, 38% of the journa Bly 
supplied 80.5% of the citations. In the ERIC/CRIER total | 
sample 29% of the journals supplied 80.2% of the KWwOC 


citations... » 


The data of this study confirmed the hypotheses: 


. _ 1)’. In the three sainple siaratlaes 
\ _ __ analyzed the large journal con- 

mm tributors to each population — 
contributed approximately 50% 
of the citations. The rule of » 
Pareto- like distribution was con- » 
firmed. 


‘ a ih 14 a? 


2) In the three small sample popu- 

lations analyzed Price's find- , 
ings concerning determination 4 
of an 80% core of a biblio- 
graphy was not upheld. Price 
found that in a large biblio- 
graphy, less than 10% of the 

a journals satisfied 80% of 

the demand. Analysis of \cita- 
tions in small bibliographic 
populations has shown t ta. 


ecessary to account’ for an —- \ 
0% core of citations in an ; 
entire collection or entire 

random sample, 


te ‘journals, 20%-30%,-w 


Price's rules of distribution were applied to three 
journal populations: The al represented ‘in the 
. unique portion of of 'the random sample from the KWOC index 


of Literature baiesh in Reailing, the journals represented 


in the unique portion of t ¢ random sample from the KWOC 
index pe rare a0 and the journals 7 
represe! ed in the entire random sample from the KWOC 
“index of Recent Research in Reading. | 
The results of application of bie: cule of Pareto- 
Like distribution ‘to the three sample populations derived 
from the KWOC indexes showed fairly good correspondence 
with expected results. The square root of the total 
population supplied 48%, 55% and wae of the citations 
in ‘the journal populations studied. The investigator 
concluded that these samples tended eee the rule 
“of Pareto=like distribution, The number of high ranking 
ee equal to the square root of the total population 


mOpetias approximately half the citations in.the journal 
15 
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| populations analyzed. In the three sample populations | 


studied 44%, 38% and 29% of the top ranked journals were 

necessary to supply 80% of the citations. The . journal 

populations totaled 112 journals, 26 journals and 51 

journals, respectively, The first two populations repre- C 
sented partial samples. The last population represented 

a complete random sample from the ERIC/CRIER collection. 

While these bibliggranhies represented closely related ' 


| 


topics, the most ted journals in the two collections Aa 


differed considerably. ~ Sok 


/ 
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In view of (‘phe lack of correspondence concerns the 
measure for dete mination of an 80% core of journal citations 


between the Prig -Urquhart data and the results of /this study, 


{ 


| 
further een: ae is indicated. It seems sede Cais the 


growth of ees, eige or demand, does not. proceed as a fixed 

percentage of the total EopHTecess eiac, it seems 

likely that the |, curve Pipodwaaeies the proportion of . ges 
journals contributing an 80% core of journal citations | ( 

from a collection would demonstrate a geometric relation- 

ship between the size of the collection and the number of = 
high ranking joursale producing an 80% core of citations. | 
Clearly the data in this study showed that for small : 
journal populations ranging in size from 6 to 112 Jjourtale, 
considerably more than 10% of the journal were necessary 
to saeety dy of the ektertonss Based on the data of 
Mayes' study, the ‘data of Summers (1968) nd the data éf 
Price (1963), the number of journals con pihoting the core 


80% of the bibliographic products in thoge collections of 


research tended to vary. inversely with the size of the { 


population. | _ A 


The advantages of using of growth facts in connection 
-with bibliographic citations such a8 those of Pareto= like: 
eoeteabyylen and core journal analysis accrue to. both” — | 
cesearchers and librarians. ‘Once. a bibliographic “sample f 
| “ has been analyzed, researchers tntoresttd in a good .  H a 
|| ei central portion of available data on a subject, ‘need, only 
| . consult: the number of top-ranked journals eq 1 te the 
square root of ih otal population,. oe lis | * 
| a ' brarians building a eblieettes.on sé subject ean organize 
| “a good working collection of representative articles by 
consulting a relatively small number of journale, once 
‘a master bibliography in’the subject has been analyzed 
as to its journal contributors. In any established: area, : 
; a relatively small number of journals will contribute 50 
per cent of the citations. Another, somewhat larger 
number of journals will contribute an "80% care of cita-. 
tions. Growth tendencies and rules of distribution such | 


as those applied in this study give new and useful infor-. 


mation to those interested in building and using journal 
collections, Thus, qe verification of growth tendencies 
and rules of distribution. in bibliographic populations is 


‘of importance.to both librarians and researchers, 
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